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Abstract 



The reverse engineering problem with probabihties and sequential behavior is intro- 



> 

o 

(y-^ I ducing here, using the expression of an algorithm. The solution is partially founded, 



_ because we solve the problem only if we have a Probabilistic Sequential Network. 

O 

I Therefore the probabilistic structure on sequential dynamical systems is introduced 



here, the new model will be called Probabilistic Sequential Network, PSN. The 



^ ' morphisms of Probabilistic Sequential Networks are defined using two algebraic 



conditions, whose imply that the distribution of probabilities in the systems are 
close. It is proved here that two homomorphic Probabilistic Sequential Networks 
have the same equilibrium or steady state probabilities. Additionally, the proof of 
the set of PSN with its morphisms form the category PSN, having the category of 
sequential dynamical systems SDS, as a full subcategory is given. Several examples 
of morphisms, subsystems and simulations are given. 
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1 Introduction 



Probabilistic Boolean Networks was introduced by I. Schmulevich, E. Dougherty, 
and W. Zhang in 2000, for studying the dynamic of a network using time dis- 
crete Markov chains, see p^20f22|l2T] . This model had several applications 
in the study of cancer, see |^. It is important for development an algebraic 
mathematical theory of the model Probabilistic Boolean Network PBN, to de- 
scribe special maps between two PBN, called homomorphism and projection, 
the first papers in this direction are, [SflO] . We will use the acronym PBN, 
PSN, or SDS for plural as well as singular instances. Instead of this model is 
being used in applications, the connection of these two digraphs of the model: 
the graph of genes and the State Space is an interesting problem to study. The 
introduction of probabilities in the definition of Sequential Dynamical System 
has this objective. This paper is the first part of this theory. 

The theory of sequential dynamical systems (SDS) was born studying networks 
where the entities involved in the problem do not necessarily arrive at a place 
at the same time, and it is part of the theory of computer simulation, [3lB] . 
The mathematical background for SDS was recently development by Lauben- 
bacher and Pareigis, and it solves aspects of the theory and apphcations, see 



The introduction of a probabilistic structure on Sequential Dynamical Systems 
is an interesting problem that it is introduced in this paper. A SDS induces 
a finite dynamical system {k^,f), for the classifications of Linear Dynamical 
Systems see [9], but the mean difference between a SDS and FDS is that there 
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exits another graph with new information giving by the local functions, and 
an order in the sequential behavior of these local functions. It is known, that 
a finite dynamical systems can be studied as a SDS, because we can construct 
a bigger system that in this case is sequential. Making together the sequen- 
tial order and the probabilistic structure in the dynamic of the system, the 
possibility to work in applications to genetics increase, because genes act in 
a sequential manner. In particular the notion of morphism in the category 
of SDS establishes connection between the digraph of genes and the State 
Space, that is the dynamic of the function. Working in the applications. Pro- 
fessor Dougherty's group wanted to consider two things in the definition of 
PBN: a sequential behavior on genes, and the exact definition of projective 
maps between two PBN that inherits the properties of the first digraph of 
genes. For this reason, a new model that considers both questions and tries 
to construct projections that work well is described here. I introduce in this 
paper the sequential behavior and the probability together in PSN and my 
final objective is to construct projective maps that let us reduce the number 
of functions in the finite dynamical systems inside the PBN. One of the mean 
problem in modeling dynamical systems is the computational aspect of the 
number of functions and the computation of steady states in the State Space. 
In particular, the reduction of number of functions is one of the most impor- 
tant problems, because by solving that we can determine which part of the 
network State Space may be simplified. The concept of morphism, simulation, 
epimorphism, and equivalent Probabilistic Sequential Networks are developed 
in this paper, with this particular objective. 

This paper is organized as follows. In section [2], a notation slightly different to 
the one used in [13] is introduced for homomorphisms of SDS. This notation is 
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helpful for giving the concept of morphism of PSN. In section HI the probabilis- 
tic structure on SDS is introduced using for each vertex of the support graph, 
a set of local functions, more than one schedule, and finally having several 
update functions with probabihties assigned to them. So, it is obtained a new 
concept: probabilistic sequential network (PSN). The concept of morphism of 
PSN is defined with two conditions, one of the most interesting results in this 
paper is that these algebraic conditions implies a probabilistic condition about 
the distribution of probabilities in both PNS, it is proved in Theorem 15. 2[ In 
Theorem 15.31 is proved that two homomorphic PSN have the same equilibrium 
or steady state probabilities. These strong results justify the introduction of the 
dynamical model PSN as an application to the study of sequential systems. 
In section El we prove that the PSN with its morphisms form the category 
PSN, having the category SDS as a full subcategory. Several examples of 
morphisms, subsystems and simulations are given in Section 16. 1[ 



2 Preliminaries 



In this introductory section we give the definitions and results of Sequential 
Dynamical System introduced by Laubenbacher and Pareigis in [13]. Let F be 
a graph, and let Vr = {1, . . . , n} be the set of vertices of F. Let {ki\i G Vr) be 
a family of finite sets. The set ka are called the set of local states at a, for all 
a G Vp. Define k"' := ki x ■ ■ ■ x kn with < oo, the set of (global) states of F. 
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2. 1 Sequential Dynamical System 

A Sequential Dynamical System (SDS) JF = (F, (/c,)"^]^, (/j)[L]^,Q;) consists of 

1. A finite graph V = (Vr, -Er) with the set of vertices Vr = {I, . . . ,n} , and 
the set of edges E-p ^ Vr x Vp. 

2. A family of finite sets {ki\i G ^r). 

3. A family of local functions fi:k"'—>-k"', that is 

where /(xi, . . . , x„) depends only of those variables which are connected 
to i in r. 

4. A permutation en = a ) vertices Vr, called an update 
schedule ( i.e. a bijective map a : Vr — > Vr). 

The global update function of the SDS is / = /q,^ o . . . o f^^^. The function / 
defines the dynamical behavior of the SDS and determines a finite directed 
graph with vertex set /c" and directed edges (x, /(x)), for all x G /c", called 
the State Space of JF, and denoted by Sf. 

The definition of homomorphism between two SDS uses the fact that the ver- 
tices Vr = {I, . . . ,n} of a SDS and the states A;" together with their evaluation 
map fc" X Vr 9 (x, a) t— >< x, a >:= x^ G fcj, form a contravariant setup, so that 
morphisms between such structures should be defined contravariantly, i.e. by 
a pair of certain maps : F — A, and the induced function : ^ /c" 
with the graph A having m vertices. Here we use a notation slightly different 
that the one using in |13j . 
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Let F = (r, {fi : k"" k"), a) and G = (A, {gi : k"^ k"'),P) be two SDS. Let 
: A ^ r be a digraph morphism. Let (0f, : k^(^b) — ^ kb,Wb G A), be a family 
of maps in the category of Set. The map /i<^ is an adjoint map, because is 
defined as follows: consider the pairing k"' xVp 3 {x, a) ^< x, a >:— Xa £ ka] 
and similarly /c™ x Va 3 {y,b) ^< y,b >:= E k^. The induced adjoint map 
holds < h^{x), b >:— 4>b{< 4>{b) >) — (t>b{X(t>{b))- Then 0, and (0^) induce the 
adjoint map /i^ : A;" — > defined as follows: 



Then /i : F — > G is a homomorphism of SDS if for all sets of orders 
associated to (3 in the connected components of A, the map /i^ holds the 
following conditions: 



k"" r ' fc" 



where {/3i, A+i, . . . , /3s} ^ (f) ^{ai). If ^(cKj) = 0, then Idkm oh^^h^o fai, 
and the commutative diagram is now the following: 



k"" 

I ^4 
i 



I ^4 
i 



(3) 
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For examples and properties see [13]. It that paper, the authors proved that 
the above diagrams imphes the following one 



,n 



i 




(4) 



2.2 Probabilistic Boolean Networks 




[T91I201I221I23] The model Probabilistic Boolean Network A = A(T, F, C) is 

defined by the following: 

(1) a finite digraph T = (Vr, Er) with n vertices. 

(2) a family F = {Fi, F2, . . . , F„} of ordered sets Fi = {fa, fi2, fu(i)} of 
functions fij : {0, 1}" — > {0, 1}, for 2 = 1, ■ ■ ■ , n, and j = 1, . . . , l{i) called 
predictors, 

(3) and a family C = {cij}ij, of selection probabilities. The selection probability 
that the function fij is used for the vertex i is Qj. 

The dynamic of the model Probabilistic Boolean Network is given by the vector 



functions = {fik^, f2k2, fnk„) ■ {0, 1}" ^ {0, 1}" for 1 < ki < and 



fiki G Fi, acting as a transition function. Each variable Xi G {0, 1} represents 
the state of the vertex i. All functions are updated synchronously. At every 
time step, one of the functions is selected randomly from the set F^ according 
to a predefined probability distribution. The selection probability that the 
predictor fij is used to predict gene i is equal to 
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There are two digraph structures associated with a Probabihstic Boolean Net- 
work: the low-level graph F, and the high-level graph which consists of the 
states of the system and the transitions between states. The state space S of 
the network together with the set of network functions, in conjunction with 
transitions between the states and network functions, determine a Markov 
chain. The random perturbation makes the Markov chain ergodic, meaning 
that it has the possibility of reaching any state from another state and that 
it possesses a long-run (steady-state) distribution. As a Genetic Regulatory 
Network (GRN), evolves in time, it will eventually enter a fixed state, or a set 
of states, through which it will continue to cycle. In the first case the state 
is called a singleton or fixed point attractor, whereas, in the second case it is 
called a cyclic attractor. The attractors that the network may enter depend 
on the initial state. All initial states that eventually produce a given attrac- 
tor constitute the basin of that attractor. The attractors represent the fixed 
points of the dynamical system that capture its long-term behavior. The num- 
ber of transitions needed to return to a given state in an attractor is called the 
cycle length. Attractors may be used to characterize a cells phenotype (Kauff- 
man, 1993) [TT]. The attractors of a Probabilistic Genetic Regulatory Network 
(PGRN) are the attractors of its constituent GRN. However, because a PGRN 
constitutes an ergodic Markov chain, its steady-state distribution plays a key 
role. Depending on the structure of a PGRN, its attractors may contain most 
of the steady-state probability mass p]ll7ll24j . 



8 



3 The reverse engineering problem with probabilities, and sequen- 
tial behavior 

Here, we give a method that permit us to build sequential systems with prob- 
abilities assigned to its update functions. This algorithm made possible to 
understand the concept of Probabihty Sequential Network and it is dedicate 
to Prof. Rene Hernandez-Toledo. 

3.1 Algorithm: The reverse engineering problem with probabilities, and se- 
quential behavior 

Input: 

1. n = number of entities in the network under studying, for example 100 
genes, and the set of values for each entity, that we denote by ka- 

2. A set of relations {m^.b} taking 1 if the entity a is related to the entity 6, 
and otherwise. 

3. A set of finite families of states in the network which gives the time series 
data for one, two or more update functions, Ai — {(aji, . . . , (i\n-ii ^\,7i)\^ — 
i < m^}, . . ., and A, = . . . , a,^„_i, <„)|1 < i < mj. 

4. A set of values C — {ci, . . . , c^} with s probabilities obtained in some way 
by the experiment or by the time series data. That is Ci -|- • • • -|- = 1, and 

Ci e [0,1]. 

1) Creation the low level graph F: 
1. Vr = {1, . . . , n} is the set of vertices, ka gives a set of values to each vertex 

a, 
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2. Er = {{a,b)\if rria^i, = 1} We obtain this graph, using the experiment 
giving by the speciahsts for example, see [7] 

(Alm2) Denoting /c" = /ci x ■ ■ ■ x we construct the local functions fai : k"' ^ k"' 
using the data giving by the experiment, associated to that we have the 
statistics of the entities and we give the probability to each function using 
the activity of the vertex. Finally we have a set of families of functions that 
we denote by Fa = {fai '■ k"" k'^\l < i < ^(«)}, where £{i) is the number 
of local functions associated to the vertex a. 

(Alm3) The possible types of sequential behavior giving by the experiment, or we 
suppose two or three orders of action with the possibility to determine which 
one is better for the network, so we define a = {ai ... ctn) in the set of 
vertices Vr- 

(ALM4) We assigns probabilities to each update function. We have The number of 
update functions is the number of different set Aj with the time series data 
for the functions. 

(Alm5) We select a subset of functions such that the behavior of the network 
are closer the experiments, using the probabilities giving in the set C = 
{ci, . . . , Cs}, selected by the experiments. 

(Alm6) We construct the high level digraph with the selected functions by the set 
C in (Alm5). 

Output: V = (r, {Fj|2r, {kaTa^,, («.)r=i, C = {Ci, . . . , cj). 

Example 3.1 Input: 

1. n = 3; ki = k2 = k^ = Z2 = {0, 1}. 

2. {mi,2 = 0, m2,3 = 1, mi,3 = 0}. 

3. The data for two update functions : A\ = {(0, 1, 0); (1, 1, 1); (1, 1, 0); (1, 1, 1)}, 
/l2 = {(0,1,1); (0,1,0); (0,1,1); (0,1,0)}. 
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4- We assign the following probabilities to the function C = {2/3, 1/3}, using 
statistic see for example JBS, 

Running the algorithm, we obtain that: 

2 3 

(Alml)Low level graph T, Vr = {1,2,3} T 

1 

(Alm2) We have two update functions, for the family Ai, and for A^. With 
A\ we have a local function associated to the vertex \, fu = {1,X2,X3), and 
for A2 we have a trivial function /12 = Id, one associated to the second vertex 
2, /21 = Id for both families, and one for the vertex 3, that we can find using 
the usual method for boolean functions, or the method giving in ^2j. We have 
the following functions Fi = {fu = (1, 0:2, X3), /12 = Id}, F2 = {/21 = Id}, 
and one for the vertex 3, that we can find using the usual method for boolean 
functions: F3 = {/3i(a;i, 2:2, X3) = (xi, X2, X2a^)}. fij : ^2^ ^2'^, for all local 
function. 

(Alm3) We select an order a = (1 2 3) in the set of vertices Vr- So we have 
two update functions 

fi{xi,X2,X3) = {xi,X2,X2X^) and /2(xi, X2, X3) = (l,X2,a;2X^). 

(Alm4) The probability c\ = .66667 for fi, and 02 = .33333, for f2- 

To solve the reverse engineering problem with probabilities, and sequential 
behavior we need to prove the algorithm always runs for a set of data. 

First, the low level graph is always possible to obtain, similarly with the sets 
kai and the families Ai, but instead of we know that always a function with co- 
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ordinate functions acting simultaneously induce a sequential function like our 
interested functions, we know that this problem is very complicated and is an 
open problem when we want to preserve the number of vertex in the sequential 
function. For solutions of the reverse engineering problem, see pfSfTS] . 

Proposition 3.2 Let f : he a function with coordinate functions 

f = (/i, . . . , /„), and let a = ■ ■ ■ a{n)) be a permutations of the vertex 

of r. If in the functions fa(i) only appears the variables Xa{j) such that j < i 

thenf = fa{l)0- ■ -ofain), whcrC fi{Xi, . . . , Xn) = {Xi,...,Xi_i,fi,Xi+i,...,Xn). 

So, our claim holds. 

PROOF. The proof is trivial. In fact, using induction and the simple case 
when a = {1 ... n) we have tha t if the function /j only use the vari- 
ables Xi, . . . ,Xi, and the function only use Xi, . . . , then o fi = 

(2^1, . . . , /j— 1, /j, 3^1+1, • • • 5 Xn). 

4 Probabilistic Sequential Networks 

The following definition give us the possibility to have several update functions 
acting in a sequential manner with assigned probabilities. All these, permit 
us to study the dynamic of these systems using Markov chains and other 
probability tools. 

Definition 4.1 A Probabilistic Sequential Network (PSN) 
V = (F, {F4fir, (fc.)Li, («,)r=i, C = {c^, c.}) 
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consists of: 

(1) a finite graph T = {Vr,Er) with n vertices; 

(2) a family of finite sets {ka\a G l^r)- 

(3) for each vertex a ofV a set of local functions 

Fa = {/a^:A;"^r|l<2<^(0}, 

is assigned, (i. e. there exists a bijection map ~: — >■ {Fa\l < a <n}) 
(for definition of local function see Ii2.1[ 2)). 

(4) a family of m permutations a = {ai . . . an) in the set of vertices Vr- 

(5) and a set C = {ci, . . . , Cg], of assign probabilities to s update functions. 

We select one function in each set Fa, that is one for each vertices a of F, 
and a permutation a, with the order in which the vertex a is selected, so 
there are n possibly different update functions fi = fain ° • • • ° fa„in^ where 
n < n\xi[l) X . . .xi[n). The probabilities are assigned to the update functions, 
so there exists a set S = {/i, . . . , /s} of selected update functions such that 
Ci = Pifi), l<i<s. 

Definition 4.2 The State Space of T) is a weighted digraph whose vertices are 
the elements of fc" and there is an arrow going from the vertex u to the vertex 
V if there exists an update function fi G S, such that v = fi{u). The probability 
p{u, v) of the arrow going from u to v is the sum of the probabilities Cf. of all 
functions fi, such that v = fi{u), u > fi{u) = v. We denote the 

State Space by Sx>. 

For each one update function in S we have one SDS inside the PSN, so the 
State Space Sj is a subdigraph of Sd. When we take the whole set of update 
functions generated by the data, we will say that we have the full PSN. It is 
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very clear that a SDS is a particular PSN, where we take one local function 
for each vertex, and one permutation. The dynamic of a PSN is described by 
Markov Chains of the transition matrix associated to the State Space. 



Example 4.3 Let V — (F; Fi, F2, F3; Z2^; cci, 0:2; (c/Jf^i), be the following 
PSN: 

!• • 3 

(1) The graph T: ^ | . 

2 • 

(2) Let X — {xi,X2,X3) e {0, 1}^. In this paper, we always consider the oper- 
ations over the finite field Z2 = (0, 1}, but we use additionally the following 
notation Xi — Xi + l. Then the sets of local functions from 'L-i ^L-i are the 
following 



Fl = {fll{x) = {l,X2,X3),fi2{x) = {Xi,X2,X3))} 

F2 = {/2i(a;) = {xi,xiX2,X3)} 

F3 = {faiix) = {xi,X2,XiX2),f32ix) = (xi, Xs, a;ia;2 + Xg)} 



(3) The schedules or permutations are ai — {3 2 1); a2 — {1 2 3). We obtain 

the following table of functions, and we select all of them for V because the 
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probabilities given by C. 



fl = /3I O /2I O /ll /2 = /ll O /2I O /3I 

/a = /32 O /2I O /ll /4 = /ll O /2I O /32 

/5 = /3I O /2I O /l2 /e = /l2 O /2I O /3I 

fr = fz2 O /2I O /12 /s = /l2 O /2I O /32 

The update functions are the following: 

fl{x) = (1, X2, X2) f2{x) = (1, X1X2, X1X2) 

fi{x) = (1, X2, X2 + Xz) f^ix) = (1, X1X2, X1X2 + Xs) 

f^{x) = (xi, (xi + l)x2) fe{x) = (xi, X1X2, X1X2) 

f'j{x) = (xi, {xi + l)a;2, (xi + l)x2 + X3) /8(a;) = (xi, X1X2, X1X2 + X3) 

(4) The probabilities assigned are the following: c/^ = .18;c/2 = ■12;c/3 = 
.18; c/, = .12; c/, = .12; c/, = .08; c/, = .12; Cf, = .08. 

Example 4.4 We notice that there are several PSN that we can construct 

with the same initial data of functions and permutations, but with different set 
of probabilities, that is, subsystems ofV. For example if S' — {fi, f2, fs, f^}, 
F[ = {fu}, and D = {df, = .355, d/^ = .211, d/3 = .12, ci/^ = .314}, then 

B = (r; Fi, F2, F3; Z2^ ai, ^2; D = {.355, .211, .12, .314}), 
is a PSN too. 
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5 Morphisms of Probabilistic Sequential Networks 



The definition of morpliism of PSN is a natural extension of the concept of 
homomorphism of SDS. In this section we prove in Theorem 15.21 a strong 
property, that is the distribution of probabilities of two homomorphic PSN 
are enough close to prove Theorem 15.31 

Consider the following two PSN Vi = (P, (FJI^Y'', {ka)]^^^, {a^)j, C) and 
V2 = (A, (Gb)j,t'r'", ih)r=i, {P^)j, D). We denote by Si the set of update func- 
tions of "Dj, i = 1,2; and the following notation for {u,v) G /c" x fc", and 
(w,z) e fc™ X A;"*, 



Cf{u,v) = < 



P{f) if f{u) = V 
otherwise 



> , dg{w,z)) = < 



pig) if 9{w) = z 
otherwise 



where p{h) is the probability of the function h. 

Definition 5.1 (Morphisms of PSN) A morphism h : Vi —* V2 consist of: 

(1) A graph morphism : A P, and a family of maps in the category Set, 
(0b : /C(^(b) — s> kj^h G A), that induces the adjoint function h^, see 

(2) The induced adjoint map h^ : ^ k"^ holds that for all update functions 
f in Si there exists an update function g E S2 such that h is a SDS- 
morphism from (P, (/ : fc" k"'), aj) to (A, {g : k"^ — > k"^), Pj). That is, 
the diagrams\^ 0, anc?[7] commute for all f and its selected g. 



(5) 



The second condition induces a map fj, from Si to ^2, that is /i(/) = g if the 
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selected function for / is g. We say that a morphism h from Vi to V2 is a PSN- 
isomorphism if (p, h^, and /i are bijective functions, and d{h^{u)^ h^{g{u)) = 
c{u,f{u)) for all u, in fc", and all / G S*!, and all g G S'2. We denote it by 
Vi = V2. 

Some theorems 

Theorem 5.2 T/ie morphism h : Vi —>■ V2 induces the following probabilistic 
condition: 

For a fixed real number < e < 1, the map satisfies the following: 

maxu,v\cf{u,v) - dg{h^{u),h^{v))\ <e (6) 

for all f in Si, and its selected g in S2, and all {u,v) G /c" x /c". 

PROOF. Suppose 0, and satisfy the Definition 15 .11 and 

\cf{u,v) - dg{h<p{u) , h^{v))\ > 1 

for some {u,v) G A;" x /c". Then we have one of the following cases 

1. Cf{u,v) = 1 and dg{h^{u),h^{v)) = 0. It is impossible by condition (2) in 
definition 15. 1[ In fact, if we have an arrow going from u to v = f{u), then 
there exists an arrow going from /^^(n) to = g{h^{u)) by diagram [5l 
and the probability dg{h^{u), h^{y)) 7^ 0. 

2. c/(u, v) = 0, and dg{h^{u), h^{v)) = 1. It is impossible because at least there 
exists one element f 1 G A;", such that f{u) = vi & and Cf{u^vi) 7^ 0, then 
dg{hif,{u), h^{vi)) 7^ too. Since the sum of probabilities of all arrow going 
up from h(i^{u) is equal 1, then dg{h^{u), h^{v)) < 1, and our claim holds. 
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Therefore the condition holds, and always e exists. 

In the next theorem we will use the following notation: 

(1) = 

(2) 5* = Eg<^s^ dgt, where g^ = gogo---og,t times. 

(3) pt{u,v) =J2p Cft{u,v), and pt{h^{u), h^{v)) = J2gt ddt{h^{u), h^{v)) 

(4) Tj denotes the transition matrix of the PSN Dj, for i = 1,2, and 

Pt{u,v) = {Ti){u,v)- 

Theorem 5.3 If h : Vi — > V2 is a morphism of probabilistic sequential 
networks, then: 

Jim^ |(Ti)™„ - (T2)^^(„)^^^(„)| = 0, 

for all {u,v) G A;" X /c". That is, the equilibrium state of both systems are 
equals. 

PROOF. The condition giving by Theorem 15.21 asserts that, there exists a 
fixed real number < e < 1, such that the map satisfies the following: 

max„,^|c/(u,t;) - dg{(t){u),(l){v))\ < e 

for all / in Si, and its selected g in ^2, and all {u,v) G /c" x A;"-. 

If there is a function / going from u to v = f{u) in k"", then there exists a 
function g going from to h^{v), such that g{h^{u)) = h^{f{u)). Now, 

for m = 2, and by the Chapman-Kolmogorov equation the following 
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computation is valid 

\cf2{u,f{u)) - dg2{h^{u), g'^{h^{u)))\ = 

|c/(m, f{u))cf{f{u), f{u)) - dg{h^{u),g{h^{u)))dg{g{h^{u)),g^{h^{u)))\ = 
\cj{u, f{u))cf{f{u), f{u)) - dg{h^{u), h^{f{u)))dg{h4f{u)), h^{f\u)))\ < 
< \cf{f{u),f{u))\e+\dg{h^{u),h^{f{u)))\e < 2e, 

by condition [61 We just proved that \cf2(u, p{u))—dg2(h(i,{u), g'^{htf){u)))\ < 2e. 
Using mathematical induction over m, we conclude that, for all natural number 

m > 1 

max„jm(„) I (c/m(u, - dgm{h^{u),g'^{h^{u)))\ < me. (7) 

For m = 2, this result implies that 

\p2{u,v) - P2{h^{u),h^{v))\ < 2/ce + (5^ 

where k is the maximum number of functions going from one state to 
another in A;". The sum 6"^ is taking over the functions g that are going from 
h^{u) to hfp{v) and do not have a function / in Si associated to the function 
g. So, the sum is not over all the functions in 5*2, and we have 5^ < 1, and 
maybe 5^ = 0, see [18]. Then the above condition implies that: 

max(^u,v)ek"xkAP2{u,v) - P2{h^{u),h^{v))\ < 2ke + 6'^ (8) 

Using induction, we conclude that 

max(^u,v)ek"xkAPm{u,v) - pm{h^{u),h^{v))\ < mke + 6"^ (9) 
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for all m e N, the natural numbers. 

So, for all real number < e' < 1 there exists m e N, such that, 
\pm'{u,v) - Pm'{h4>{u),h^{v))\ < e' , 

for all natural number m' > m, and for all possible u, v & k"'. 

In fact, we have e^' -C e"*, and this implies {m'k)e^' < {mk)e^. Similarly 
^m' ^ gQ selecting m such that {mk)e^ -\- 5'^ < e', we obtain 

\Pm'{u, v) - Pm'iKiu), h^{v))\ < {m'k')e^' + 5^' < {mk)e^ + 5^ < e', 

where k' is the maximum number of functions going from one state to another 
in the state space of the power m! of the functions. We can observe that 
because the state space S-d is finite, k' < k. Therefore 

Jim^|p„/(M,v) - Pni'{h4,{u),h^{v))\ = 0, 
for all possible {u, v) E k'" x A;", and the theorem holds. 

Corollary 5.4 Two probabilistic sequential network are homomorphic if they 
have the same probabilistic equilibrium. 

PROOF. It is obvious using the proof of the theorem, because if they have 
the same probabilistic equilibrium, then the two Time Discrete Markov Chains 
have the same size. On the other hand, 5 is almost and there exists a mor- 
phism going from one PBN to the other. 

Special morphisms. Let V = (r, {Fi)f^^, {a^)j^j,C) be a PSN. 
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Identity morphism. The functions = idr, = idk^^ and /i = ids, define 
the identity morphism X : D — > D, and it is a trivial example of a PSN- 
isomorphism. 

MONOMORPHISM A morphism h of PSN is a monomorphism if (p is surjective 
and /i0 is injective. 

Epimorphism a morphism is an epimorphism if is injective and is sur- 
jective. 

Remark If the morphism h is either a monomorphism or an epimorphism, then 
the function fi is not necessary injective, neither surjective. 

6 The category PSN. Simulation in the category PSN, and Exam- 
ples 

In this section, we prove that the PSN with the morphisms form a category, 
that we denote by PSN. For unknown definitions, and results in Categories 
see the famous and old book of S. MacLane: Categories for the Working Math- 
ematicians |16j . 

Theorem 6.1 Let hi = ((f)i,h^J : Vi ^ V2 and h2 = (02)^02) • ^2 — ^ ^^3 
be two morphisms of PSN. Then the composition h = {(f), h^) = (02) ^(^.2) ° 
(01, h^J = h2ohi : Vi ^ V3 is defined as follows: h = (0, h^) = (0i o02, /i^j o 
/i<^J is a morphism of PSN. The function fih = fih2 ° A^/n- 

PROOF. The composite function = 0io02 of two graph morphisms is again 
a graph morphism. The composite function h^ = h^p^ o h^p^ is again a digraph 
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morphism which satisfies the conditions in Definition 15.11 by Proposition and 
Definition 2.7 in [13]. So, h = (0, /i^) is again a morphism. of PSN. 

Theorem 6.2 The Probability Sequential Networks together with the homo- 
morphisms of PSN form the category PSN. 

PROOF. Easily follows from Theorem 16.11 

Theorem 6.3 The SDS together with the morphisms defined in fT^ form a 
full subcategory of the category PSN. 

PROOF. It is trivial. 

6.1 Simulation and examples 

In this section we give several examples of morphisms, and simulations. In the 
second example we show how the Definition 15.11 is verified under the suppo- 
sition that a function (p is defined. So, we have two examples in (16.11 2). one 
with the natural inclusion, and the second with a surjective map. The 
third, and the fourth examples are morphisms that represent simulation of Q 
by JF. We begin this section with the definitions of Simulation and sub-PSN. 

Definition of Simulation in the category PSN. The probabilistic se- 
quential network Q is simulated by JF if there exists a monomorphism h : J-" ^ 
Q or an epimorphism h' : Q ^ J-". 

Sub Probabilistic Sequential Network We say that a PSN ^ is a sub 
Probabilistic Sequential Network of if there exists a monomorphism from Q 
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to T . If the map /i is not a bijection, then we say that it is a proper sub-PSN. 



6.2 Examples 



( 16.21 1) In the examples 14. 3[ and l4.4l we define two PSN V> and B. The functions 
{/) = /(ir, = Idk", and fi the natural inclusion from 5*1 to 5*2 define the 
inclusion : B ^ V. It is clear that the inclusion is a monomorphism, so T> 
is simulated by B. 

( 16.21 2) We now construct a monomorphism h : J-" —>■ Q, with the prop- 
erties that is surjective and the function is injective. The PSN = 
(r, (Fj)3, /5, C) has the support graph F with three vertices, and the PSN 
Q = (A, (6*4)4, «, D) has the support graph A with four vertices 




The morphism h : J-" ^ Q, has the contravariant graph morphism : A — F, 
defined by the arrows of graphs, as follows 0(1) = 1, 0(2) = 0(3) = 2, and 
0(4) = 3, so it is a surjective map. The family of functions 0j : A;<^(j) k(^i), 
0i(a^i) = Xi, 02(3^2) = 03(^2) = X2; 04(^4) = X4, are injective functions. 
The sets ka = '^2, for all vertices a in A, and F. The adjoint function is 
: Z2^ Z2^, defined by 

h^{xi,X2,xs) = (0i(xi),02(a;2), 03(2^2), 04(a;4)) = (xi, X2, 0:2, X3). 
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Then, the first condition in the definition 15.11 holds. 

The PSN = ( F; {Fi)^; (3; C), is defined with the following data. 
The set of functions Fi = { /n, /12)}, = {/21}, and F3 = {/31}, where 

fn=Id, fuiXi,X2,Xs) = {1,X2,X3), /21 = M 
f3l{xi,X2,X3) = {xi,X2,X2X^). 

A permutation = ( 1 2 3 ); and the probabilities C = {c/^ = .5168, = 
.4832}. So, we are taking all the update functions S = {/i, /2}; 

/i = /ii o /21 o /31, /i = (a;i,a;2,a;3) = {xi, X2, X2X^); 
and /2 = /12 o /21 o /31, /2(xi, X2, 0:3) = (1, X2, a;2Xi). 

On the other hand, the PSN ^ = (A; {Gi)^; a; D) has the following data. 
The families of functions: Gi = {fi'ii,fi'i2}; G2 = {921,922}, G3 = {931,932}; 
and = {94}, where 

9ll{xi,X2,X3,X4) = {1,X2,X3,X4) 

92l{Xl, X2, X3, X4) = (Xi, 1, 2:3, X4) 9i2 = Id = 922 

5f3l(xi,X2,X3,X4) = (xi,X2,XiX2,X4) 932{Xi, X2, X3, X4) = (oJi, X2, X2, X4) 
94l{Xl,X2,X3,X4) = (Xi,X2,X3,a;2Xl) 

One permutation or schedule a = {1 2 3 4). The assigned probabilities dg^ = 
.00252, dg^ = .08321, dg^ = .51428, dg^ = .39999 whose determine the set of 
update functions X = {95, 96, 97, 98}'- therefore the all update functions are 
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the following 

gi = gn ° g2i o gsi o g4i, g2 = gu o g2i o g^2 o gn g^ = gi2 o g2i o gsi o g^i, 

g4 = 5-11 o g2i o gz2 o g4i g^ = gu o g22 o gsi o g^i, = gu o g22 o g^i o g^i ■ 

gr = gi2 o g22 o g32 o gn, gs = gu ° g22 o g32 o g^i 

The selected functions are 

g5{xi,X2,X3,X4) = {xi,X2,XiX2,X2xt), geixi, X2, X3, X4) = {\,X2,XxX2,X'^^ 
g7{xi, X2, X3, X4) = {xi,X2, X2, X2xt), gsixi, X2, X3, X4) = (1, X2, X2, X2XI) 

We claim that /i : — > ^ is a morphism. It is trivial that the following 
diagrams commute. 

Z3 % r/ 3 v 3 i rj 3 

2 /i ^2 ^2 /2 ^2 

^2^ ^ gl ^ Z2^ 

In fact, o /i)(a;i,a;2,a;3) = (xi, 0:2, 0:2, a;2Xi) = (^fy o /i</,)(a;i, a;2, 0:3), on the 
other hand (/i,/, o /2)(xi, X2, X3) = (1, a;2, a:2, X2Xi) = (t/s o a:2, X3) so, the 
property holds. We verify the second property in the definition of morphism 
for the compositions /i and g-j, and also with the compositions /2 and g^. That 
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is, we check the sequence of local functions too. 



Z 



'2 ^ ^2 922 0932 ^ > 7^2 



Z3 rj 3 ;> rj 3 



-^2 /31 ^2 /21 ^2 /12 ^^2 



{.K ° /3l)(a;i,X2,X3) = (xi,X2,X2,X2X^) = (5-41 ° h^){Xi, X2, X3) , 
{h^O f2l){Xi,X2,X3) = {Xi,X2,X2,X3) = ((^'22 O 5'32) O /l<^) (Xi , X2 , X3) , 

o /ii)(a;i,a;2,X3) = (xi, X2, X2, X3) = (5fi2 o /i<^)(xi, X2, X3), 
(^0 o /i2)(a;i,a;2,X3) = (1, 0:2, X2, X3) = (gn o h^){xi, X2, x^). 
Then our claim holds. 

( 16.21 3) We can construct an epimorphism h' : Q ^ J-', that is, the function (j) is 
injective and the function h'^ is surjective. We use 0' : F ^ A, defined as follow 
= i + for alH G Vr- Therefore : — 0'j : Z2 — Z2, for all i G 
Vr, and should be satisfies < h(f,{x),i >:= (pb{< x,4>{i) >) = So, the 

adjoint function is X2, X3, X4) = 0'2(x3), 0'3(x3)) = (xi,X2,a;4) 
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and satisfies the following commutative diagrams 



Z2" 



iK^ ih'^ 

f, > Z2^ Z2^ /i ' ^2^ 

si ^2^ gi ^2^ 

ih'^ i^^' i/^; i/^v 

Z2' -ig^Z2=^ ^2^ ^1^^^2' 

These implies that = //(g'r) = /i, and /^(g'e) = /^(s's) = h- In fact, 

OA's) (2^1, 2:2, 2^3, 2^4) = {xi,X-2,X2Xl) = (/i O /l'^) (xi , X2, X3, X4) , 

(^0 ° 5'6)(a;i,a^2, 3:^3, 2:4) = (1, 2:^2, 2:^2^4) = (/2 o X2, X3, X4), 

(^0 o 5'7)(a:i,a;2,a;3,a;4) = {xi,X2,X2Xl) = (/i o /i'^)(a;i, 2:2, xs, 2:4), 

(/l'^0 5(8)(xi,X2,X3,X4) = (1,X2,X2X4) = (/2 O h'^){xi, X2, X3, X4) . 

Checking the compositions of local functions — gi2 o g22 o g^i o g^i , and 
/i = /ii o /21 o /31, we have that the following diagrams commute 

2^4 _gi2_ ^ 2^4 _g22_ ^ ^^4 _g3^ ^ ^^4 _g4^ ^ ^^4 

h'^i ih'^ ih'^ ih'^ ih'y 

Z2^ > Z2^ > Z2^ > Z2^ > Z^ 
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By the data we only need to check the following compositions 

h'^{93l{xi,X2,X3,X4,)) = {xi,X2,X4,) = f2l{h'^{xi, X2, X3, X4,)) , 

h'^{g4i{xi, X2, X3, X4)) = (xi,X2,a;2X4) = f3i{h'^{xi,X2,X3,Xi)). Similarly, we 
can prove that the other functions hold the property. 

7 Equivalent Probabilistic Sequential Networks 

Definition 7.1 (Equivalent PSN) // the morphism h : Vi ^ V2 satisfies 
that (p, htj, and /i are bijective functions, but the probabilities are not necessary 
equals, we say that Vi, and T>2 are equivalent PSN. We write X>i ~ D2- 

So, Pi, and V2 are equivalents if there exist {(p.h^.ji), and /i^^, 
such that for all update functions f & Vi and its selected function g ^1)2, the 
condition f — h^^ o g o h^j, holds . It is clear that this relation is an equivalence 
relation in the set of PSN. 

Proposition 7.2 IfVi ~ V2, then the transition matrices Ti and T2 satisfy: 
iTr){u,v) ^ 0, if and only if {T^){h^(u),h^{v)) + 0, for all m e {u,v) e 
A;" X A;". 

PROOF. It is obvious. 
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